Web Survey Bibliography
Survey researchers frequently compare measures of attitudes across surveys where response scales are very similar but not identical, such as when different neutral response options are offered. However, inconsistent neutral options may affect how respondents report their attitudes .To explore this issue, an experiment by Knowledge Networks was carried out in a web survey involving attitudes toward how to mark pedestrian crosswalks—a topic specifically chosen due to its non-controversial nature. Respondents (n=692) were randomly assigned to receive a set of seven questions measured on a 5-point agree/disagree scale using either a “neither agree nor disagree” response option placed in the middle of the scale or a “no opinion” response option placed at the end of the scale. In six out the seven questions, respondents were significantly more than 1.5 times as likely to choose the “neither agree nor disagree” response when it was available to them than to choose the “no opinion” response when it was available (smallest Χ2=13.91, p<.05). The results also show that when the neutral points are removed from the analysis, the relative distribution of all other response options is not statistically different between the question versions, which suggest that the wording and placement of neutral response options affects all other response categories equally. Therefore, excluding inconsistent neutral response categories may allow for more accurate comparability between attitudes measured across different surveys.
Conference Homepage (abstract) / (presentation) / (full text)
Web survey bibliography - DiSogra, C. (16)
- Metrics and Design Tool for Building and Evaluating Probability-Based Online Panels; 2015; DiSogra, C.; Callegaro, M.
- Cell RDD Respondents Unmasked: Progress Report on Geo and Demo Appends to the Wireless Frame; 2015; DiSogra, C.; Kennedy, C.Mosher, M.
- Using Probability-based On-line Samples to Calibrate Non-probability Opt-in Samples; 2012; DiSogra, C., Cobb, C. L., Chan, E., Dennis, J. M.
- Seasonal Yield Variation and Related Response Patterns in Address-based Mail Samples; 2011; DiSogra, C., Hendarwan, E.
- Observed Differences in the Placement and Wording of Neutral Response Options in Web Surveys: An Experiment...; 2011; Walton, L., Cobb, C. L., DiSogra, C.
- Calibrating Non-Probability Internet Samples with Probability Samples Using Early Adopter Characteristics...; 2011; DiSogra, C., Cobb, C. L., Chan, E., Dennis, J. M.
- Address-based Sampling Nets Success for KnowledgePanel® Recruitment and Sample Representation; 2010; DiSogra, C.
- Results of Targeting Pre-Identified Minority, Unidentified Non-Internet and Vacant Homes in Two National...; 2010; DiSogra, C., Hendarwan, E.
- Maximizing a stratified ABS frame for nation-wide mail recruitment of a probability-based online panel...; 2010; DiSogra, C., Hendarwan, E.
- Using an ABS frame to recruit a probability-based online panel; 2009; DiSogra, C.
- The Challenge and Importance of Including Spanish- Dominant Latinos in Online Panel Studies Addressing...; 2009; DiSogra, C., Wells, T., Torres, J.
- Do we hear different voices?: Investigating the differences between internet and non-internet users...; 2009; Zhang, C., Callegaro, M., Thomas, M., DiSogra, C.
- Panel Conditioning and Attrition in the AP-Yahoo! News Election Panel Study; 2009; Kruse, Y., Callegaro, M., Dennis, J. M., DiSogra, C., Subias, S., Lawrence, M., Tompson, T.
- Recruiting Probability-Based Web Panel Members Using an Address-Based Sample Frame: Results from a Pilot...; 2009; DiSogra, C., Callegaro, M., Hendarwan, E.
- Computing Response Rates for Probability-Based Web Panels; 2009; DiSogra, C., Callegaro, M.
- Computing Metrics for Online Panels; 2008; Callegaro, M., DiSogra, C.